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Abstract 

A majority logic decoder made of unreliable logic gates, whose failures are transient and data- 
dependent, is analyzed. Based on a combinatorial representation of fault configurations a closed-form 
expression for the average bit error rate for an one-step majority logic decoder is derived, for a regular 
low-density parity-check (LDPC) code ensemble and the proposed failure model. The presented analysis 
framework is then used to establish bounds on the one-step majority logic decoder performance under the 
simplified probabilistic gate-output switching model. Based on the expander property of Tanner graphs 
of LDPC codes, it is proven that a version of the faulty parallel bit-flipping decoder can correct a fixed 
fraction of channel errors in the presence of data-dependent gate failures. The results are illustrated with 
numerical examples of finite geometry codes. 
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Index Terms 

Data-dependence, faulty hardware, LDPC codes, majority logic decoding, probabilistic gate-output 
switching model. 


I. Introduction 

Increased integration factor of integrated circuits together with stringent energy-efficiency constraints 
result in increased unreliability of today’s semiconductor devices. As a result of supply voltage reduction 
and the process variations effects, a fully reliable operation of hardware components cannot be guaranteed 

a 

Von Neumann first considered a problem of reliability of systems constructed from unreliable compo¬ 
nents 0. His approach includes multiplexing of component logic gates and relies on high redundancy 
to achieve the desired system reliability. Dobrushin and Ortyukov j3| refined von Neumann’s method 
and provided upper bounds on the required redundancy for reliable computation of a Boolean function 
implemented using faulty gates. On the other hand, Elias 01 applied more general coding techniques to 
the problem of reliable computing. He showed that except for some particular cases, such as exclusive-OR 
function, there is no code that outperforms von Neumann’s multiplexing method. Overviews of problems 
in fault tolerant computation is given by Winograd and Cowan 0 and Pippenger f6l . 

Error control coding, as a method for adding redundancy to ensure fault-tolerance of memory systems 
built from unreliable hardware, was introduced in the late sixties and early seventies by Taylor |j7] and 
Kuznetsov 0. In their memory system an information sequence, encoded by a low-density parity-check 
(LDPC) code, is stored in unreliable memory cells, which are periodically updated using a “noisy” 
correcting circuit. They proved that, under the so-called von Neumann failure model, such a memory - 
even with a number of redundant gates linear in memory size - is capable of achieving arbitrary small 
error probability 0. The equivalence between Taylor-Kuznetsov (TK) fault-tolerant memory architectures 
and a Gallager-B decoder, built from unreliable logic gates, was first observed by Vasic et al. in 0 and 
na, and developed by Vasic and Chilappagari fTTll into a theoretical framework for analysis and design 
of faulty decoders of LDPC codes. 
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Performance of ensembles of LDPC codes under faulty iterative decoding was studied by Varshney in 
urn who showed that, if certain symmetry conditions are satisfied, the density evolution technique is 
applicable to faulty decoders which he used to examine the performance of faulty Gallager-A and belief- 
propagation algorithms. Density evolution analysis of noisy Gallager-B decoders was presented in the 
series of complementing papers by Yazdi et al. in |[T3l and lfT4l and by Huang et al. in fT5l . In lfT3l the 
authors studied the performance of the binary Gallager-B decoder used to decode irregular LDPC codes 
and proposed optimal resource allocation of noisy computational units, i.e., variable and check nodes 
of varying degrees, in order to achieve minimal error rate. The faulty decoder of non-binary regular 
LDPC codes was analyzed in lfl4l in the presence of von Neumann errors. In lfT~5ll a more complicated 
failure model was considered, which includes transient errors and permanent memory errors. Similar 
analysis was done by Leduc-Primeau and Gross in lfl6l . where the faulty Gallager-B decoder, improved 
by a message repetition scheme, was studied. More general finite-alphabet decoders were investigated 
by Huang and Dolecek in ifTTl . while a noisy min-sum decoder realization was considered by Ngassa et 
al. in lfT8l and by Balatsoukas-Stimming and Burg in fT9l . Dupraz et al. ll20l have improved the notion 
of a noisy threshold by introducing the so-called functional threshold, which accurately characterizes the 
convergence behavior of LDPC code ensembles under noisy finite-alphabet message passing decoding. 

Although complex soft-decision iterative decoders, built from reliable components, typically outperform 
low-complexity majority logic decoders, this is not necessarily true for faulty decoders. In addition, a 
simple probabilistic gradient decent bit-flipping decoder, recently proposed by Al Rasheed et al. j2T1 . 
achieves high level of fault-tolerance. Recently, Vasic et al. lf22ll showed that probabilistic behavior 
of the Gallager-B decoder due to unreliable components can lead to the improved performance. This 
resulted in an increased interest in hard-decision decoders. In our previous work lf23l we investigated the 
performance of Gallager-B decoder under timing errors and showed that the density evolution technique 
is not applicable to that case. 

In all the above references a special type of so-called transient failures is assumed. Transient failures 
manifest themselves at particular time instants, but do not necessarily persist for later times. These failures 
have probabilistic behavior and we assume the knowledge of their statistics. The simplest such statistics is 
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the von Neumann failure model (2j, which assumes that each component of a (clocked) Boolean network 
fails at every clock cycle with some known probability. Additionally, failures are not temporally nor 
spatially correlated. In other words, failures of a given component are independent of those in previous 
clock cycles and independent of failures of other components. 

However, the von Neumann failure model is only a rough approximation of physical processes leading 
to logic gate failures. The actual probability of failure of a logic gate is highly dependent on a digital 
circuit manufacturing technology, and for high integration factors the failures are data-dependent and/or 
temporally correlated, as it was shown by Zaynoun et al. | [24ll . For example, errors caused by incorrect 
switching of a gate output are heavily dependent on data values processed by the gate in previous bit 
intervals and cannot be represented accurately by the von Neumann model. 

One-step majority logic (OS-MAJ) decoding, introduced in the sixties by Rudolph ll25l . is an important 
class of algorithms in the context of faulty decoding. A OS-MAJ decoder can be seen as a Gallager-B/bit- 
flipping decoder ll26l in which the decoding process is terminated after only one iteration, and bits are 
decoded by a majority vote on multiple parity-check decisions. In contrast to iterative decoders, the bit 
error rate performance of these decoders can be evaluated analytically for finite-length codes, as shown 
by Radhakrishnan et al. l27ll . Instead of error rate analysis, iterative decoders are analytically evaluated 
in terms of guaranteed error correction capability. 

Guaranteed error correction of LDPC codes has been only studied for the iterative decoders built from 
reliable components. Sipser and Spielman |[28l showed that expander LDPC codes can be conveniently 
used to guarantee the correction of a fraction of errors, i.e. there exist some a, 0 < a < 1 , for which the 
decoder can correct an worst case errors, where n is the code length. They proved that both serial and 
parallel bit-flipping algorithms can correct a fixed fraction of errors if the underlying Tanner graph is a 
good expander. In the later work Burshtein f29l generalized their results and proved that a linear number 
of errors can be corrected by the parallel bit-flipping algorithm with almost all codes in (7 > 4, p > 7 )- 
regular ensemble. The expander graph arguments can be also used to provide guarantees of the message 
passing algorithms, at it was shown by Burshtein and Miller lf30l and linear programming shown by 
Feldman et al. ffil . Recently, Chilappagari et al. f32ll provided another look on the guaranteed error 
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correction of the bit-flipping algorithms. They found the relation between the girth of the Tanner graph 
and the guaranteed error correction capability of an LDPC code. 

In this paper we examine the effects of data-dependent gate failures to performance of the bit-flipping 
decoding. We propose a gate state model that captures the effects of data-dependent and correlated nature 
of gate failures. We derive a closed form expression of the bit error rate (BER) at the output of the OS- 
MAJ decoder for an ensemble of regular LDPC codes free of four-cycles. Then, we derive bounds on 
BER performance under a simplified data-dependent model, called the probabilistic gate-output switching 
model. Additionally, we investigate the error correction capabilities of the noisy bit-flipping decoders and 
show that expander graph arguments can be used to establish lower bounds on the guaranteed error 
correction capability in the presence of data-dependent gate failures. 

The rest of the paper is organized as follows. In Section HD the preliminaries on codes on graphs are 
discussed. In Section [Till we give a description of novel approach to gate failure modeling. Section [TV] is 
dedicated to the theoretical analysis of the OS-MAJ decoder under general modeling approach. The special 
case of the data-dependent failure model is further analyzed in Section [V] The error correction capability 
of the noisy bit-flipping decoder is investigated in Section [VT] The numerical results are presented in 
Section IVIII Finally, some concluding remarks and future research directions are given in Section IV111I 

II. Preliminaries 

Let G = (U. E) be a graph with a set of nodes U and a set of edges E. An edge e is an unordered pair 
( v,c ), which connects two neighborly nodes v and c. The cardinality of U, denoted as \U\, represents 
the order of the graph, while \E\ defines the size of the graph. A set of neighbors of a particular node u 
is denoted as J\f{u). The number of neighbors of a node u, denoted as d(u), is called the degree of u. 
The average degree of a graph G is d = 2|i?|/|C/|. 

The girth g of a graph G is the length of smallest cycle in G. A bipartite graph G = (V U C, E) is a 
graph constructed from two disjoint sets of nodes V and C, such that all neighbors of nodes in V belong 
to C and vice versa. The nodes in V are called variable nodes and nodes from C are check nodes. A 
bipartite graph is said to be 7 -left-regular if all variable nodes have degree 7 , and similarly, a graph is 
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p-right-regular if all check nodes have degree p. 

Consider a ( 7 , pj-regular binary LDPC code of length n and its graphical representation given by 7 - 
left-regular and p-right-regular Tanner bipartite graph G, with rr//p check nodes and n variable nodes. In 
a part of this paper we consider expander codes, i.e. LDPC codes whose Tanner graphs satisfy expansion 
property defined as follows. 

Definition 1 . /| 2 # 1 / A Tanner graph G of a ( 7 , p)-regular LDPC code is a ( 7 , p, a, 5) expander if for 
every subset S of at most an an variable nodes, at least check nodes are incident to S. 


Let x = ( 27 , X2, • • •, x n ) be a codeword of a binary LDPC code, which appears at the input of a binary 
symmetric channel (BSC). The output of the channel r = ( 77 , r 2 ,...,r n ), where Pr {77 f 27 } = p, is 
being decoded by our majority logic decoder. The number of flipped bits represents the Hamming distance 
between the transmitted codeword x and the received word r, and is denoted as d#(x,r). The decoder is 
divided into processing units that correspond to nodes in Tanner graph representation of the decoder. Let 
77 tj(e) and /n,(e) be messages passed on an edge e from variable node to check node and check node to 
variable node, during the i-th decoding iteration, respectively. Similarly rfti(F) and m,(F) denote sets 
of all messages from/to a variable node over a set of edges F C E. We next summarize our majority 
logic decoder. 

• At iteration i = 0 the variable-to-check messages are initialized by using values received from 
the channel, i.e. r&i(e) = r v , Ve € N(v). At iteration i, i > 0, a variable node processing unit 
v performs the majority voting on binary messages received from its neighboring check nodes as 
follows 


v))) = < 


s, if \{e' € M{v) : i(e') = s}| > [7/2], 

r v , otherwise, 


( 1 ) 


where s € { 0 , 1 } and [7/2] denotes the smallest integer greater than or equal to 7/2. The output 
of the majority logic (MAJ) gate, described by the function '!'(■) is then passed to all neighboring 
check nodes, i.e 7 ?tj(e) = Ve € A f(v). 

• During each iteration i, i > 0 , a check node processing unit c performs p eXclusive-OR (XOR) 
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operations defined as follows 

*(^(Af(c) \ {e})) = 0 ( 2 ) 

e'€A/(c)\{e'} 

The results of the XOR operations represent estimates of bits associated to neighboring variable 
nodes and they are passed by mapping frii ( e ) = (r&i(J\f(c) \ {e})), Ve € Af(c). 

If the decoding is terminated after the i-th iteration, the result of $(trii(J\f (v))) represents the decoded 
bit x v . Note that, when built from perfectly reliable logic gates, our decoder is functionally equivalent 
to the parallel bit-flipping decoder lf28l . Hardware unreliability in the decoder comes from unreliable 
computation of the operations 'k(-) as XOR logic gates performing these functions are prone to data- 
dependent failures, which are described in the following section. 

After each decoding iteration, the code bits are estimated based on the function <&(•), which results 
in probability of error of an estimated bit that is greater than or equal to the probability of failure of 
the MAJ gate performing this function. Since the error probability of the MAJ gate lower bounds the 
BER performance, MAJ gates must be made highly reliable. Otherwise, the probability of error would be 
determined by this gate, not by the error control scheme. Thus, it is reasonable to make an assumption 
that MAJ gates are perfect and that only the XOR gates are faulty. Reliable MAJ gates can be realized, 
for example, by using larger transistors. Similar assumptions regarding perfect gates were also used in 
other relevant literature 0, G2, El- 

When the decoding is terminated after only one iteration, and a bit x v is decoded by $(tno(N(v))), 
our decoder is reduced to the known OS-MAJ decoder, recently analyzed in our previous works ll33l . 
l34l . In the first part of this paper we specially consider the OS-MAJ decoder, due to its simplicity. 

III. Data-Dependent Gate Error Model 
A. General Modeling Approach 

Let / : {0, l} m —>• {0,1}, m > 1, be an m-argument Boolean function. The relation between input 
arguments y^\y^f \.. .y$ and an output z- k> , at time instant k > 0, of a perfect gate realizing this 
function is = f (y[ k \ y^\ ..., yin 1 ) . The output of a faulty gate is f(y[ k \y[ k \...,yl^) © 
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where © is Boolean XOR, and the error at time k, ^■ k> € {0,1}, is a Bernoulli random variable. Denote 
by y( k) = (y[ k \y 2 k \ ■ ■ ■,Urn ) a gate input vector, i.e., a vector of arguments. Denote by {y^}fc>o a 
time-sequence of input vectors, and by {£^}fc>o a corresponding error sequence. In this manuscript we 
will interchangeably use the terms “failure” and “error” meaning that failures are “additive” errors. In the 
classical von Neumann transient failure model the error values {^ <k> }/->o are independent of the input 
sequence {y (fc) }fc>o- 

In order to capture data and time dependence of gate failures more accurately, we propose the following 
gate-state model. Namely, we assume that is affected by the current and M — 1 prior consecutive gate 
input vectors, i.e., its probability depends on the input vector sequence in the time interval [k—(M— 1), k\, 
denoted as {y^}je[fc_(Jtf-i),A;], where M is a positive integer. Denote this probability by Pr{£ (/;:) = 
l|s( fc )}, where a gate state s ^ at time k is defined as s ^ = {y^}_ 7 e[fc-(M-i),fch As previously stated, 
in our decoder only XOR gates are unreliable. The number of states grows exponentially with M and p, 
i.e., for a (p — l)-input XOR gate, used in our decoder, there are 2 M (p-t) states. 

The inputs of a (perfect) MAJ gate are the outputs of 7 XOR gates in the neighboring check nodes. 
Thus, at time k these gates can be associated with a state array a (k ^ = (s k \ .... si k> ), whose 
elements represent states of particular XOR gates. Based on an error probability vector can be 
formed as e^ = (e^ k \e^ k \ ■ ■ ■, e^), = Pr{£( fe ) = l|sm^}, 1 < m < 7 . The values of the error 

probability vector can be obtained by measurements or by simulation of the selected semiconductor 
technology. Thus, in our analysis we assume that these values are known. 

B. Probabilistic Gate-Output Switching Model 

Due to supply voltage reduction, switching of a gate output is prolonged and the signal is sampled or 
used in the next stage before it reaches a steady value. Recently, Amaricai et al. ll35l investigated the 
probabilistic nature of gate switching for subpowered CMOS circuits. They proposed several fault injection 
models in CMOS circuits in which errors are added only when the gate output changes. Translated to 
our model, this means that it is sufficient to consider the case M = 2. 

In this subsection we define the probabilistic gate-output switching model (GOS), in which the logic 
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gate switches incorrectly with a probability that depends on a supply voltage, temperature and considered 
gate delay. This model was shown to have reduced complexity with minor degradation of accuracy when 
compared to more complex models that take into account the fact that different input patterns cause 
failures with different probabilities. 

In the GOS error model the probability that a XOR gate fails to switch at time k is Pr{<f ^ = 
l\z^ ^ z (k '>} = e, where e > 0. On the other hand, when the gate output is unchanged during two 
consecutive time instants, the function / is always correctly computed as assumed in ll36l and 031 . i.e. 

Pr {£(fc) = !| z (k) = z {k- 1)| = o 

Note that the GOS model does not capture all effects which may lead to timing-related errors, since 
changes of the multiple inputs can cause a gate failure, even if the ideal output remains unchanged ll24l . 
However, in the most recent literature dedicated to CMOS circuits operating with a voltage supply near 
or below the threshold voltages 031 . P6l . the above effects were neglected. The general framework 
presented in the previous subsection is applicable to other more complicated scenarios. 

IV. Analysis of the OS-MAJ Decoder under the General Gate Error Model 

In this section we present an analytical method for performance evaluation of an ensemble of regular 
LDPC codes with girth at least six decoded by the faulty OS-MAJ decoder, described in the previous 
sections. In the Tanner graph of a code with girth at least six, the variable nodes connected to the 
neighboring j checks, of a variable node v, are all distinct. First, we consider a particular code bit x v 
and calculate the probability that it is miscorrected, under a fixed state array associated to the XOR gates 
used for decoding of x v . 

Let q/ be a vector corresponding to one lexicographically ordered rt-subset of a set [/] = {1,2,..., 1} 
and let a vector q r contain the remaining elements of [/], arbitrary ordered. We create a vector q by 
juxtapositioning q/ and q r . We can arrange all possible vectors q into rows of an ( 1 ) by / array Q u,i . For 
example, if l = 4 and u = 2, the rows of Q 2 4 are (1, 2,3,4), (1, 3,2,4), (1,4, 2,3), (2, 3,1,4), (2,4,1, 3) 
and (3,4,1,2). The array Q"‘ / is instrumental in book-keeping of data-dependent error probabilities as 
described in the following lemma. 
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Lemma 1 . The probability that a code bit x v of a ( 7 , p)-regular LDPC code is incorrectly decoded by 
the faulty OS-MAJ decoder, whose gates fail according to an error probability vector e, is given by 

7 ( l ) i 7 1 117 1 1 LiJ 7 

p»(p,e)= e y n 7 n - Pu.) + 2 — p £ n n„- n 

i=[2±±^ j=l m=l m=i +1 j =1 m= 1 m= [ttJ +1 

(3) 

w/iere P q . m = e qjm (l - A) + (1 - £ qjtm )A, 

A = 0.5(1 - (1 -2p) (p_1) ), (4) 

and <// rn denote the element in the t-th row and the m-th column of the matrix Q 77 . 

Proof: Given the fact that each received bit is erroneous with the probability p, the probability that 
the output of a fully reliable XOR gate is also erroneous is equal to A. As j-th XOR gate fails with 
the probability £j, the error at the output of j-th XOR is given by Pj = £j( 1 — A) + (1 — £j)A. Each 
row of the error configuration matrix Q*’ 7 represents one possible error configuration which results in 
appearance of exactly i erroneous bit estimates at inputs of the MAJ gate. The total number of such error 
configurations is (jj. 

A bit x v will be incorrectly decoded if the majority of its estimates are incorrect. Thus, for odd values 
of 7 , only probabilities of i being greater than or equal to (7 + l)/2 leads to a miscorrection. If 7 is 
even, then there is a possibility of a tie (equal number of correct and incorrect estimates). For such cases 
7/2 incorrect estimates can result in miscorrection, which is depicted by the second part of Eq. £j]). ■ 

Let {x (k > }k>o be a codeword sequence transmitted through the channel. Clearly, decoding error of x ik> 
depends on M — 1 codewords, previously transmitted through channel. Let x m .„ = {xm,v}j£\k-(M-i),kb 
1 < rn < 7 , 1 < v < n, be a sequence of code bits that, if transmitted with no errors, will appear at 
inputs of m-th XOR gate connected to a node v, in a time interval [k — (M — 1), k\. Then, we formulate 
the theorem which captures the decoder performance under correlated data-dependent gate failures. 

Theorem 1 . The average bit error rate (BER) of a ( 7 , p)-regular LDPC code, when a codeword sequence 
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,fc] is decoded by the faulty OS-MAJ decoder is 

P e (error) x.^ k \ ... ,x^~ M+1 ^) = — ^ P v (p,e^^j 

71 V=1 t=1 (5) 

x n p dH ( s ™'* m ’ v Xi 

m= 1 

Proof: See Appendix A. ■ 

The error probability vectors in general depend on transmitted codewords and the expression © 
describes the conditional error probability. The computational complexity of the BER expression grows 
exponentially with the left- and right-degree of Tanner graph and the memory order of the state model. 
However, different error probability vectors, , c- 2 -*,..., , may lead to the same bit error probability, 
P v (p. e - 1 ') = P v (p. e- 2i ) = ... = P v (p. c, and in practice the number of terms that need to be 
calculated is significantly lower. For example, in some important cases the average BER in the presence 
of errors caused by incorrect switching of the gate output can be obtained by computing only 7 + 1 
terms. The detailed analysis of the decoder under these errors is presented in the next section. 

In the transient gate failure model, introduced by von Neumann, the code bit error probability is 
independent of state arrays, i.e., P v [p,£^) = P (p, e), 1 < t < 2^ p ~ 1 P M , 1 < v < N. Thus, for a 
special case of von Neumann errors, that we previously investigated in If34ll . the BER expression given 
by Eq. © reduces to Eq. ©. In addition, as all XOR gates have the same failure rates = e, 1 < i < 7 , 
any configuration of i incorrect estimates is equally likely and Eq. © simplifies into expression 

Py(p,e)= J2 (|V (1 - P ) T-i + ( ~ 1} 2 7 + V ) 2 V 7/2 (1 - P ) 7/2 > ( 6 ) 

<=L(7+1)/2J VV V7/ J 

where P = (1 — A)e + A( 1 — e). 

V. Analysis of the OS-MAJ Decoder under the GOS Error Model 

The XOR gate output will remain unchanged if gate input vectors from two consecutive time points 
k — 1 and k, k > 0, are the same or differ in an even number of positions. Thus, for example, the m-th 
XOR, used for the decoding of a bit x v , will produce correct output at time k, if transmitted vectors 
and Xm.lj satisfy the relation d:jj(y^!f v V} , x^i) = 0 (mod 2) and no channel errors occur. Similarly, 
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the gate output will be erroneous with the probability e if all bits are received without errors, and if 
,Xm1v) = 1 (mod 2). However, the parity of the gate input vectors can change due to channel 
induced errors, that is when an odd number of gate inputs from two consecutive time points are flipped. 
The probability of the union of all such events is equal to 

B = J2 + i)p 2j+1 ^ ~p) 2p - 2j - 3 = ^(1 - (1 - 2p) 2 ^- 1 )). (7) 

Therefore, the gate output will be erroneous with the probability eB when the relation dn x£| t ) = 
0 (mod 2) is satisfied. Let all XOR gates, used for decoding x v , with this property, form a set Q v . Similarly, 
TL V is composed of all gates for which x|^) = 1 (mod 2). It is clear that q v u n v = [ 7 ]. 

We now extend the previous discussion on faulty XOR gates, and formulate the lemma that describes 
data-dependence of the OS-MAJ decoding. 

Lemma 2. Let x^” 1 ) and x( fc ) be codewords decoded in two consecutive bit intervals. The faulty OS-MAJ 
decoder will operate the worst if the cardinality of Q v , \Q V \ = 0, 1 < v < n, while the best performance 
corresponds to decoding of consecutive codewords for which \Q„\ = 7 , 1 < v < n. 

Proof: Failures of XOR gates from the set Q v happen with probability Be, while the failure rate 
under condition that a gate is an element of TL V is equal to (1 — B)e. Since B < 0.5 a gate from TL V 
will be erroneous more often. The proof of lemma follows from the fact that the probability P v (p,e) 
monotonically increases with the increase of hardware unreliability, i.e., for every e li ' 1 and e 1 ^ 2 - 1 with 
property Sm' > < 1 < m < 7 , P v (p,e^ tl ' ) ) < P v (p,e^ 2 ' ) ) holds. ■ 

The previous lemma reveals a fundamental property of the OS-MAJ decoding performance under data 
dependent hardware failures: the dependence on a codeword decoding order. It can be seen that, for 
example, consecutive decoding of two identical codewords will result in the lowest error rate, while if 
two complementary codewords are consecutively decoded the decoder will operate worst. 

The OS-MAJ decoder built entirely from reliable components satisfy the symmetry theorem, which 
states that performance of the decoder is independent of codewords being decoded. We see that the 
symmetry condition does not hold for the OS-MAJ decoding in the presence of errors caused by incorrect 
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switching of the gate output. 

Let the cardinality of the set Q v , be equal to \Q V \ = t v . The bit miscorrection probability, given 
by Eq. ([3]), depends only on the number of non-zero elements of e, but not on its order. Thus, we 
can simplify the notation by introducing = ( if \ £ t ,\ ■ ■ ■ , e^): an error probability vector with t 
non-zero elements. This allows us to formulate the following corollary of Theorem |T] that gives the bit 
miscorrection probability under the GOS error model. 

Corollary 1. The probability that a code bit x v of a (y,p)-regular LDPC code is incorrectly decoded by 
the faulty OS-MAJ decoder under the GOS error model is given by 

/■y t 

pm = y j p v (p, i (t> ) Y (j) n~^ B 7+2j-u-t(i_ B)U+ t- 2jf (8) 

t —0 j = tmin 

where, t m i n = max(t + t v — 7 , 0 ) and t ma x = min(t v ,t). 

Proof: The probability that j non-zero failure rates in originated from the set Q v and t — j from 
the set TLy is equal to {1 — B) tv+t ~ 2 P The sum of all possible ways that t non-zero 

failure rates can appear represents the contribution of P v (p. in the overall miscorrection probability 
value. The final summation for all 7 + 1 values of t gives the bit miscorrection probability. ■ 

Based on Lemma [2] and Corollary HI we can measure the effect of data-dependence by bounding the 
BER, as described in the following lemma. 

Lemma 3. The BER of a ( 7 , p)-regular LDPC code decoded by the faulty OS-MAJ decoder wider the 
GOS error model, P e ,GOS> ‘ s bounded by 

Y. Cf) Bt{l ~ B V~ tp v (P. £ W ) < P e,GOS < Y (]) Bl ~ t{ - X ~ (?> i(t) ) ■ W 

Proof: According to Lemma O the lower bound is obtained by setting t v = 7 in Eq. ([ 8 ]). Similarly, 
the upper bound can be calculated by setting t v = 0 . ■ 

The bounds presented in Eq. ([9]) are obtained under conditions described in Lemma[2l i.e., they represent 
the lowest and the highest possible BER values. These bounding values depend on all parameters 7 , p, 
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e and p and can differ by orders of magnitude. The analysis of the decoder performance, for several 
classes of LDPC codes, is presented in Section IVIII 

VI. Guaranteed Error Correction under the GOS Error Model 

In this section we prove that the correcting capability of the iterative majority logic decoder, built 
partially from unreliable gates, increases linearly with code length, when Tanner graph of a code satisfies 
the expansion property, defined in Section HU We assume that following two conditions are satisfied: (i) 
the MAJ gates used in the decoder are reliable, and XOR failures follow the error mechanism introduced 
in Section UTTl-R. and (ii) no more than |Cxo r gates are erroneous in the first iteration. The need for 
previously described assumptions will be discussed later. Now we formulate the theorem that gives the 
error correction capability of the noisy majority logic decoder. 

Theorem 2. Consider a ( 7 , p, a, (7/8 + e)j) expander, 1/8 > e > 0. The majority logic decoder built 
from unreliable check nodes can correct any pattern of \V\\ < ^3(3 + 8e)cm/32 — V2\Cxor\) errors. 

Proof: Let Vj be a set of corrupt variables at the beginning of the ?'-th decoding iteration. A set of 
corrupt variables at the beginning of the (i + l)-th iteration (i.e., end of the i-tli iteration), Vj+i, can be 
divided into two disjunct subsets: (i) (Vj + 1 n ly), a subset of corrupt variables that remained corrupt at 
the end of the 7-th iteration, and (ii) (Vj+i \ Vf), a subset of newly corrupted variables, i.e., variables that 
were correct in the ( i — l)-th iteration, but became corrupt during the 7-th iteration. Let Si be a set of 
variables that were corrected during the (i — l)-th iteration and also stayed correct at the end of the 7-th 
iteration. Since variables in Si are flipped in the (?' — l)-th iteration, from the definition of the GOS error 
model, it follows that any variable in Si may cause a failure of the neighboring XOR gates in the 7-th 
iteration and consequently the incorrect estimates of variables with whom it shares the neighbors. On the 
other hand, no failure of the XOR gate output occurs in the check nodes connected to only un-flipped 
variables in the (i — l)-th iteration. 

Each incorrect estimate of a particular variable in Vj + 1 \ V, is due to the variable’s connection (through 
shared neighbors) to variables from the set Vj U S-,. This comes from the fact that the check node, which 
sends an incorrect estimate to a node in Vj + 1 \ V ,, must be also connected to at least one other node 
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which causes that incorrect estimate. Thus, each incorrect estimate indicates that a check is shared by 
two variables in V U Si U V t +\. On the other hand, there are no restrictions on possible neighbors of a 
check producing all correct estimates - they can be variables in Vj + 1 \ V, or variables outside of the set 
Vi U Si U Vi + 1 - From Eq. {T}, the number of correct estimates of each newly corrupt variable in V l+ \ \ Vi 
cannot be greater than 7 / 2 , which means that the correct estimates are produced by at most 7/2 different 
neighboring check nodes. The set Vi U Si U Vj +1 has the highest number of neighbours when Si and 
V i+ i \ Vi are disjunct. Then for some 6, 0 < 5 < 1, we have 

|A f{Vi uSiU y i+1 )| < <y 7 |Vi u Si\ + 7 /2|y i+ i \ v±\. (i0) 

Variables corrected during the i- th iteration (a set Fj\ Vj + i), as well as variables from S t can be connected 
to all different check nodes. Since a variable from Vj n V 1+ \ shares at least half of its neighbours with 
other variables from Vj U Si, it contributes with at most 37/4 additional check nodes in S'/\V U 5j| and 
we have 

HVi u Si\ < 7 (| Vj| + \Si\ - \v i+1 n v\) + 3 7 /4|v i+1 n v;| 

= 7(1^1 + |^|)-7/4|V i+ inV,|. (11) 

If we assume that 

|Vi U Vi- |_i U Si\ < an (12) 

for all i > 0 , then, by the expansion property, 

\M{Vi U Si U V m )| > (7/8 + e) 7 (|Vj| + |^| + |V m \ V\). (13) 

Combining previous expression with Eq. © and Eq. © we obtain 

M( 1 - 8 e) > (3 + 8 e)|Vj + i \ VJ| + 2 |V i+1 n VJ| + ( 8 e - 1)|^| > 2|V m | - (1 - 8 e)|^|. (14) 

Because all elements of Si were corrupted before the (i — l)-th iteration, we know that S t \ < |Vj_i|, 
which, based on the previous inequality, implies 

(1 - 8 e)|Vj| > 2|V m | - (1 - 8 e)|Vj_i|. (15) 
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Let |V 2 I < fi\V\ |, j3 > 0. Then, \Vj\ can be bound as presented in the following lemma. 

Lemma 4. The number of corrupt variables before the i-th decoding iteration, i > 1, V, \ is bounded by 
VI - 8e + (2/3 - 1 + 8e)(V9 - 8e - y/l - 8e) ( 2v^8e 


\VA < 


Proof: See Appendix B. 


(1 - 8e) x /9^8e 


y/9- 8 e- VI - 8 e 


N- 


(16) 


In order to complete this part of the proof of Theorem 2, we have to analyze the first decoding iteration 
and bound |V 2 1. In the following lemma we show that the upper bound of the value \Vf\ can be expressed 
in terms of V\ | and C\o rt | , the number of XOR gate failures in the first iteration. 

Lemma 5. The number of corrupt variables after the first decoding iteration, \ V 2 1, under the condition 
|bi| < (3 + 8e)cm/4, is bounded by 

1 _ 

IV 2 I <—-—|Vi| + \Cxor\- (17) 

Proof: From the analysis presented in lf28l . we know that the decoder built from reliable components 
reduces the number of corrupt variables to at most (1 — 4r))| V) |, for all 1/4 > 4 > 0. The first summand 
in Eq. (fI7T ) is obtained noting that 8 = 1/8 + e. The second summand in Eq. (fT71) follows from the fact 
that each XOR gate failure can corrupt at most one additional variable. ■ 


Combining Eq. (fl 6 l) and Eq. (fI71) we obtain 


^ n ^4 y /T^8~e\V 1 \ + 2{V9^We-VT^8~e)\CxoR\f 2y/T=Te 
I i| - ^ ' 


(18) 


(1 - 8e)V9 - 8 e 

The previous equation shows that, for all e € (0,1/8], the number of corrupt variables reduces over time, 
which after a sufficient number of iterations leads to the correction of all initially corrupt variables. 

Note that in our derivation we also assumed that | Vi U V t+ \ U S, < an, for alii > 0 (Eq. ( 1 1 21 ) ). We 
next prove the previous statement by using mathematical induction. 

Let us assume that \S{ U Vi- 1 U V,J < an. This means that Eq. (fl8l) is satisfied for the first i — 1 
iterations and that we can use it to bound | V^_i | and | V, \. Assume, by the way of contradiction, that 
ISiU^UVi+il > an. Then, since we know that |S'*U| < an, there must exists some D C V)_|_i\(V)U5j) 


DRAFT 





















BRKIC et al.: MAJORITY-LOGIC DECODING UNDER DATA-DEPENDENT LOGIC GATE FAILURES 


17 


for which D U Si U V) = an, and |A f(D U S) U V))| > (7/8 + e)'yan. On the other hand, for some 
7/8 + e<5<l, the number of checks connected to D U Si U V) is bounded by 

|A r(D U Si U Vi)\ < «y 7 (|5i| + \Vi\) + 7/2 (an - |$| - \V l \). (19) 

Combining the previous relation with the lower bound given by the expansion, we obtain 

\Si\ + \Vi\ > > 3 + ^ 8 e an. (20) 

On the other hand, since 


N + N < |^-i| + |v;|, 


( 21 ) 


based on Eq. (fl8T) we finally obtain 


where 


9i (e) = 


r q I 

|Vi| > [9i(e)^an-g 2 (e)\C XO R\ i 
(V9-8e- Vl- 8e)(l - 8e) / \/9 - 8e - Vl - 8e V" 1 


and 


4(V9 - 8e + VI - 8e) V 2V1 - 8e 

. y/9 — 8e — \/l — 8e 

52(e) =---• 


( 22 ) 


(23) 


(24) 


The function 51(e) is monotonically increasing on the interval (0,1/8], and its minimal value on this 
interval satisfies m i n (51(e)) > 3/8. Similarly, the maximal value of the function 52(2) on the same 
interval is max (52(e)) = \[2. Since 1/Vl — 8e > 1 we can conclude that inequality (f24l) contradicts 

0<e<l/8 

our initial assumption about \V\ \ given in the theorem formulation, and hence S t U V) IJ V)+i| < cm for 
all i > 2. When i = 2, Eq. (l20l) reduces to 


|Vi|> 


3 + 8e 


an — \Cxor\ 


J 3-8e’ 


(25) 


which also contradicts our initial assumption. Finally, the condition | V\ U V21 < an follows from the Eq. 
(fT71) and initial condition for [ V] \. This proves the theorem. ■ 


In the previous analysis we assumed that XOR gates are unreliable, but not the MAJ gates. If we allow 
MAJ gates to be prone to data-dependent gate failures, the error correction cannot be guaranteed. This 
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follows from the fact that in the worst case scenario correction of every variable can be annulled by the 
MAJ logic gate failure. 

Note that the decoder’s correcting capability depends not only on the expansion property of its Tanner 
graph, but also on the number of XOR failures in the first iteration (| CxorD- F° r too many XOR gate 
failures during the first iteration, the decoding process will not converge to a correct codeword. Recall 
from the GOS error model that \Cxor\ depends on the XOR gates failures at time instant prior to the first 
decoding iteration. We do not have any control over the number of XOR gate failures before decoding 
has started, but there is a practical way to overcome this, and force \Cxor\ to be zero. Before we start 
decoding a new codeword we can force all transistor-level transient processes in the decoding circuitry 
to reach a stationary state, so that there are no transitions at gate outputs nor accumulated errors, prior to 
the start of decoding. Practically, this can be done by slightly slowing down the clock in the first iteration 
and letting the signal level stabilize. Since the clock is slower, there are no-timing errors and the XOR 
computations are reliable, which yields \Cxor\ =0. 

We next compare our results with the results from lf28ll where a reliable decoder was considered. It can 
be observed that the presence of the XOR gate failures reduces the number of errors that can be tolerated 
by the bit-flipping decoder. For example, when the Tanner graph has the expansion of (7/8 + e), the 
perfect decoder can correct 9/16cm errors, which is two times higher than the error correction capability 
of the faulty decoder. In the limiting case e = 1/8 the number of correctable errors is upper bounded 
by 3an/8, which is only the 3/8 of the number of errors correctable by the decoder built from reliable 
components. 

The problem of explicit construction of expander graph, with the expansion arbitrary close to 7 (called 
lossless expanders), was investigated by Capalbo et al. in 1 137 1 . where it was shown that the required 
expansion 7/8 + e can be achieved with graph left-degree 7 = poly(log(7/p), 8/(1 — 8e)). This proves 
the existence of a expander code that can tolerate a fixed fraction of errors under data-dependent gate 
failures. 

Another proof of the guaranteed error correction of LDPC codes was provided by Chilappagari et al. 
in (32[, where the correction capability of an LDPC code was expressed in terms of girth of Tanner 
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graph. In the following theorem we extend the results presented in fl32l to the case of the noisy decoder. 

Theorem 3. Consider an LDPC code with 7 - left-regular Tanner graph with 7 > 8 and girth g = 2go- 
Then, the majority logic decoder built from unreliable check nodes can correct any error pattern \ V\ 
such that |Vi| < 9no(7/4, go)/32 — \/2 \Cxor\> where 

j —1 

re 0 (7/ 4 >5o) = n 0 ( 7 / 4 , 2 j + 1) = 1 + -j- ^ Q) , go odd , 

i =0 

j —1 . 

noh/fdo) = ^ 0 ( 7 /4,2j) = 2^ Q) , go even. (26) 

t =0 

Proof: In order to prove the theorem we use the following lemma. 

Lemma 6. The number of checks connected to a set of variable nodes V in ■'/-left-regular Tanner graph 
with girth g = 2po satisfies 

mV)\>7\V\-f(\V\,g 0 ), (27) 

where f(\V\,go) represents the maximal number of edges in an arbitrary graph with V | nodes and girth 
90 - 

Proof: See i32l . ■ 

Based on the Moore bound, we know that the number of nodes n(d,go) in a graph with the average 
degree d > 2 and girth go satisfies li38l 

n(d,go)>n 0 {d,g 0 ), (28) 

where no(d, go) is defined in Eq. (l26l) . On the other hand, since 7/4 > 2 the graph with | V| < no( 7 / 4 , go) 
nodes must have average degree smaller than 7 / 4 . Then, based on the definition of the average degree 
follows 

f(\V\,go) < 7 IVI/ 8 . (29) 

Combining the previous expression with Eq. d27l) we obtain 

l-A/WI > 77/8- (30) 
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Note that it was shown in ll32l that 7 > 4 represents a sufficient condition for the guaranteed error 
correction on a Tanner graph with girth g. However, due to logic gate failures higher expansions (Eq. 
(l30l) ) are required compared to the perfect decoder, but the other conclusions remain the same as for the 
perfect decoder. 


VII. Numerical Results 

A. Error Probability Analysis 

The codes designed from finite geometries are considered to be an important class of one-step majority 
logic decodable codes 1391 . It was proven that for an LDPC code, derived from finite geometries, the 
OS-MAJ decoder can correct up to |_7/2j errors. In this section we investigate 2-dimensional affine 
and projective geometry LDPC codes over the Galois field GF(2 S ), denoted as AG(2, 2 s ) and PG(2, 2 s ) 
codes, s > 0, respectively. The affine geometry codes, AG(2, 2 s ), have right-degree p = 2 s + 1, left-degree 
7 = 2 s and minimum distance dmin = 2 s + 1. The PG(2, 2 s ) code is characterized by p = 7 = 2 s + 1 
and minimum distance d m i n = 2 s + 2. 

The average bit error probabilities for several PG and AG codes, under the GOS error model, are 
presented in Fig. Q] The performance upper bounds are calculated using Eq. © for the case of two 
XOR gate error rates e = 10 —3 , 10' 2 and compared to the case of e = 0, i.e., with the perfect decoder. 
It should be noted that lower the above bounds correspond to rare hardware failures, and can be well 
estimated using 

J2 (]) Bt (! - By- l P v (77e W ) ~ Pv ip, (0, • • ■ ,0)). (31) 

This is the reason why they are omitted from Fig. Q] 

It can be seen that frequent hardware failures can lead to significant performance degradation. This 
degradation is especially pronounced in the region with low BSC crossover probabilities. For example if 
p = 10 -3 , extremely unreliable XOR gates (with s = 10“ 2 ) can reduce the bit error rate by an order of 
magnitude for all presented codes. On the other hand, hardware failures corresponding to e = 10 3 , cause 
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(a) AG codes 


(b) PG codes 


Fig. 1: Analytically calculated BER bounds. 


significantly smaller performance loss. Performance loss is lower for higher s, which results in negligible 
BER degradation for codes with s = 4, i.e., AG(2, 2 4 ) and PG(2, 2 4 ). Since e = ICG 3 is considered to 
be a large value of the gate failure probability, the OS-MAJ decoder is in general proved to be resistant 
to hardware unreliability. For smaller values of e (e < 10 ~ 3 ), the BER degradation is negligible for all 
the analyzed codes. 

As a convenient measure of the performance variation caused by incorrect output switching, we define 
a data-dependence factor, F, as the ratio of the two border BER values, given by Lemma [3j as follows 

Eto OB’-'fl -B)‘P„(p, £<■>)■ 

The values of F, for different (7, p) classes of LDPC codes, are presented in Fig. [2] It can be seen that 
the degradation is higher in codes with larger 7. For example, when p = 10 ~ 3 , for codes with 7 = p = 5, 
the BER upper bound is more than seventy times higher than the corresponding lower bound. As error 
correction capability of a code increases with 7, it is interesting to notice that the better codes are more 
susceptible to negative effects of hardware failures, for the same p value. Additionally, it can be shown 
that the performance loss can be reduced by increasing the degree of check nodes. 
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Fig. 2: The data-dependence factor values for different ( 7 , p) classes of LDPC codes (e = 10 2 ). 


B. Guaranteed Error Correction 

From Theorem 2 follows that the number of errors that can be corrected depends on the expansion 
property, represented by a and e, and the hardware failures inherited from the time instant prior to 
the decoding, \Cxor\- Here we provide an upper bound on a fraction of channel errors, ottotai = 3(3 + 
&e)a/?>2—\/2 \Cxor\/ that can be corrected by the decoder. We use the following lemma to numerically 
obtain the upper bound. 

Lemma 7. Let a* and e* be such that a to t a i(cx*, e*) > a to tai (cc, e), 0 < a < 1, 0 < e < 1/8. Then, they 
satisfy the following relation 

e* = (1 — (1 — a*Y)/{a*p) - 7/8. (33) 

Proof: The previous relation follows from the ||28l Theorem 25], where it was shown that a set of an 
variables can have at most ny( 1 — (1 — a) p )/ p + 0(1) neighbors and the fact that we look for graphs 
which expand by at least a factor of (7/8 + e). ■ 

In Fig. 0 a) we express at 0 tai{od , e*) in terms of \Cxor\/r, for different p-right-regular Tanner graphs. 


DRAFT 








BRKIC et al .: MAJORITY-LOGIC DECODING UNDER DATA-DEPENDENT LOGIC GATE FAILURES 


23 




(a) Maximal tolerable fraction of errors (b) Number of tolerable errors 


Fig. 3: Guaranteed error correction under GOS error model. 


We consider only cases where p > 8. We can observe that, for example for p = 8, when the influence 
of inherited failures can be neglected, we can potentially correct more than 1% of erroneous bits. In 
addition, a code correction capability reduces with the increase of p. When XOR gate failures prior to 
the decoding become comparable with the correction capability of a code, a threshold is reached and the 
bound rapidly decreases. The threshold is independent of p. For sufficiently large | CxoR I /fi the decoder 
performance is degraded up to the point where no error correction can be guaranteed. This happens, for 
example for p = 8, when \CxoR\/n > 1%. 

Another perspective on the error correction of the noisy decoders is provided in Fig. Ob). Flere we 
examine how the girth of 7-left-regular Tanner graphs affects the decoder performance. In addition, we 
compare the results given by Theorem 3 with the correction capability of the noisy OS-MAJ decoder, 
expressed by [7/2_| — | C'xon \ ■ It can be observed that the error correction bound, guaranteed by Theorem 
3, for small girth (g < 8), is not tight. It is actually lower compared to the known OS-MAJ decoder 
correction capability. However, for higher girths of Tanner graphs, the results given in Theorem 3 are 
significant. For example, when g = 12, \Cxor\ = 0 and 7 = 12, we can guarantee correction of error 
patterns with weight 7, which is not possible using the OS-MAJ decoder. 
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VIII. Conclusion 

While the von Neumann error model is suitable for theoretical evaluation of fault-tolerant systems, 
applicability of the results obtained under this error model to real-world systems is limited. In practice, 
unreliability of logic gates is usually data-dependent and correlated in time. Hence, in order to describe 
hardware unreliability phenomenon more accurately, a change of modeling paradigm is required. We 
advocate the use of the state models, which provide a more general modeling approach. Then, based on 
the data-dependent gate failure model, we developed an analytical method for the performance evaluation 
of the OS-MAJ decoders. Our method enables calculating the BER of any regular LDPC code of girth 
at least six. These BER values are highly dependent on the decoded codewords and we have succeeded 
to bound them for the case of errors caused by the probabilistic nature of gate switching. 

In addition, based on the expander properties of Tanner graphs, we established conditions required 
that correction capability of the majority logic decoder increases linearly with the code length. Although 
we were able to show that this property is achievable for codes with high left- and right-degrees, our 
results present the first known results regarding the guaranteed error correction of LDPC decoders made 
of unreliable components. 

The future research includes the investigating fault-tolerant schemes which use other types of LDPC 
decoders, under data-dependent hardware failures. We are working on generalization of our results to 
more complex iterative decoders, such as, for example, finite-alphabet iterative LDPC decoders. Based on 
the structural property of Tanner graphs of LDPC codes, we are also investigating possibility of designing 
novel decoders that can work well under data-dependent hardware failures. 

Appendix A (Proof of Theorem I) 

The expression given by Eq. £3) represents the miscorrection probability for an arbitrary chosen bit 
under one hardware failure scenario, i.e., one state array <r u:> . 

A particular XOR state s™ , 1 < m < 7, will appear if channel errors change only certain bits of 
the code sequence x m The number of such bits is equal to the Hamming distance between the error- 
free code sequence and the XOR state s„ . As the inputs of XOR gates are not mutually dependent, 
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the probability of the state array c-w occurrence can be derived by multiplexing individual XOR state 
probabilities and we have 

p (o-W') = Yl >*"■'’). (34) 

m =1 
(k) 

The error probability of a bit xjj , under assumption that a fixed sequence of M codewords was 
transmitted through the channel, can be derived by summing the products P (o-w) P v (p,e'- t >) obtained 
for all possible error vectors 6^,1 < t < 2 ^-^ m and the BER can be derived by performing one 
additional averaging over all code bits. 


Appendix B (The Proof of Lemma 4) 


Based on Eq. ( fT71) we know that for * > 1 

OC 

^(2|V i+1 | - K\Vi\ - KlVi-^x* < 0, 


i=2 


where K = 1 — 8e. The previous expression can be rewritten as, 

v(x)(2 -Kx- Kx 2 ) - (2\V 2 \ - K\Vi\)x + 2\Vi\ < 0, 
where v(x) represents the generating function defined as 

OO 

v ( x ) = E^+il 

The function v(x) can be bound as follows 


x . 


i=0 


, . (2/3-K)x + 2 lTr . 

V(X) < - -rj— - -\Vl\ = 


(xi - x)(x 2 - x) 
(: 2j3-K)x + 2 


(2/3 — K)x2 + 2 2/3 + K 


K{x i — x)(x 2 — x) K(x i — x) 




L K(x i-x 2 ) 


O O I 7V- 

E v - E v) + E vj m 


i=0 i=0 z=0 

where aq = —(1 + \J\ + 8/K)/2 and X 2 = (y/l + 8/K — l)/2. Then, we have 


Wi\ < 


2 + (2/3 - K)x 2 2 + (2/3 - K)x i 

■(Co , , Xi 


J\(x 2 - Xl) 


K(x 2 - xi) 


N 


2 + (2/3 - K)x 2 _j r 2 + (2/3 - AT )aq / x 2 \ * 

AT(x 2 -xi) X2 I. 2 + (2/3 - AT)x 2 Vxi 


|Vi|. 


(35) 


(36) 


(37) 


(38) 


(39) 
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Since for all i > 0 and 2(3 > K 


2 + (2/3 — K)x\ / x 2 y 
2 + (2/3 - K)x2 \xi) ~ 


(40) 


we finally have 


_ 4 v / l‘ r 8e + (2/3 - 1 + 8e)(V9- 8e - VI - 8e) 
(1 - 8e)V9 Tr 8e 


2V1 - 8e 


V9 - 8e - VI - 8e 


|Vi|. 


(41) 
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